Generalised Exponential Families and Associated Entropy Functions

نویسنده

  • Jan Naudts
چکیده

A generalised notion of exponential families is introduced. It is based on the variational principle, borrowed from statistical physics. It is shown that inequivalent generalised entropy functions lead to distinct generalised exponential families. The well-known result that the inequality of Cramér and Rao becomes an equality in the case of an exponential family can be generalised. However, this requires the introduction of escort probabilities.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Deformed Algebras and Generalizations of Independence on Deformed Exponential Families

A deformed exponential family is a generalization of exponential families. Since the useful classes of power law tailed distributions are described by the deformed exponential families, they are important objects in the theory of complex systems. Though the deformed exponential families are defined by deformed exponential functions, these functions do not satisfy the law of exponents in general...

متن کامل

Information Theory and Statistical Mechanics Revisited

We derive Bose-Einstein statistics and Fermi-Dirac statistics by Principle of Maximum Entropy applied to two families of entropy functions different from the Boltzmann-Gibbs-Shannon entropy. These entropy functions are identified with special cases of modified Naudts’ φ-entropy. In a pioneering work sixty years ago, Jaynes [4] initiated the study of statistical physics by information theory. He...

متن کامل

The Tsallis Distribution and Generalised Entropy: Prospects for Future Research into Decision-Making under Uncertainty

1. Introduction This paper reviews recent work on the properties of Tsallis distributions, Tsallis statistics, anomalous diffusion and multi-fractal processes. Processes of this kind have the capacity to represent natural phenomena that are associated with turbulence and emerging complexity. However, in addition they may also capture crucial aspects of human decision-making in response to condi...

متن کامل

Bounds on approximate steepest descent for likelihood maximization in exponential families

An approximate steepest descent strategy converging, in families of regular exponential densities, to maximum likelihood estimates of density functions is described. These density estimates are also obtained by an application of the principle of minimum relative entropy subject to empirical constraints. We prove tight bounds on the increase of the log-likelihood at each iteration of our strateg...

متن کامل

0 30 70 65 v 3 2 A pr 2 00 4 Generalised definitions of certain functions and their uses

Generalised definitions of exponential, trigonometric sine and cosine and hyperbolic sine and cosine functions are given. In the lowest order, these functions correspond to ordinary exponential, trigonometric sine etc. Some of the properties of the generalised functions are discussed. Importance of these functions and their possible applications are also considered. PACS No.: 02.30.Hq, 02.30.Gp...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • Entropy

دوره 10  شماره 

صفحات  -

تاریخ انتشار 2008